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INTRODUCTION 

Most  problems  in  surveillance  and  communications  involve  the  specific 
determination  of  whether  or  not  one  of  a  library  of  complex  signals  is  sent 
within  a  fixed  observation  interval  T.  In  radar,  this  library  is  composed  of 
time-displaced  versions  of  a  certain  known  waveform,  while  in  communications 
the  library  is  either  a  set  of  linearly  independent  waveforms  or  unique  linear 
combinations  of  those  waveforms  (references  1,  2). 

Figure  1  illustrates  the  determination  of  signal  existence  which  is  known 
as  M-ary  Signal  Hypothesis  Testing  and  its  most  common  detection  strategy.  A 
time-varying  voltage  v(t)  from  a  receiving  device  such  as  an  antenna  or  hydro¬ 
phone  is  input  to  a  set  of  signal  correlators,  whose  outputs  are  sent  to  an 
"optimum"  processor  designed  to  establish  signal  presence(s) .  The  hypotheses 
being  evaluated  are  the  null  hypothesis  Hq  where  the  voltage  v(t)  is  just 
random  background  and/or  electronic  noise.  The  signal  presence  hypothesis 
where  the  input  voltage  is  random  noise  plus  one  or  more  of  M  possible  wave¬ 
forms  (t)  ;  j  -  1,  M)  . 


f  ~ 
J  0 


/  - 


Figure  1  Receiver  configiiranon  for  <)  M  ary  signal 
filler  trank 
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The  specific  form  of  the  signal-presence  processor  depends  on  the 
application,  the  type  of  random  noise  involved, and  the  particular  performance 
criteria  adopted  by  the  system  designer  (references  1,  2).  However,  the 
correlator  bank  approach  is  always  computationall^-frntensive  for  large  signal 
libraries,  no  matter  what  the  application  or  noise  process (es)  involved. 

The  intent  of  this  paper  is  to  describe  a  Maximum  Likelihood  Ratio  Test 
(MLRT)  which  determines  signal  presence(s)  in  a  near-optimal  fashion  and  with 
minimal  computational  load.  Specifically,  a  log- likelihood  ratio  test  is 
presented  which  preprocesses  input  data  with  a  single  filter  developed  from  a 
M-ary  signature  library.  This  test  indicates  whether  one  or  more  of  the  M 
possible  signal  waveforms  is  present  in  the  input. 

The  above  type  of  test  is  analogous  to  the  Uniformly  Most  Powerful 
Invariant  Test  developed  by  Scharf  for  unknown  amplitude  M-ary  signal 
detection  in  noise  (reference  3).  Here,  this  test  is  developed  independently 
from  both  a  signal  detection  and  estimation  point-of -view.  When  signal 
presence  is  indicated,  the  input  voltage  train  is  processed  by  a  signal  vector 
estimation  filter,  whose  output  is  a  Least -Mean- Square  (LMS)  or  Maximum 
Likelihood  (ML)  estimate  of  the  amplitudes  of  the  linearly  independent  signals 
detected. 

In  this  paper  the  above  detection  strategy  is  tested  against  computer¬ 
generated  noise-only,  signal-plus-noise  data  sequences,  and  the  results 
validate  the  theory.  In  addition,  comparisons  are  made  between  MLRT  and  cor¬ 
relator  bank  receivers  for  single  signal  presence  detection  in  Additive  White 
Gaussian  Noise  (AWGN) .  The  results  indicate  that  there  is  only  a  small 
decibel  advantage  for  the  latter  when  M  is  large.  However,  this  advantage 
disappears  for  multiple  signal  detection  scenarios,  independent  of  the  size  of 
M. 
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MAXIMUM  LIKELIHOOD  RATIO  TEST 
OF  LINEARLY  SUPERIMPOSED  SIGNALS 

Consider  an  L-element  sample  set  of  received  radar,  communication,  or 
lexicographic  ally  mapped  image  data  having  the  form 

-  (x^ ,  x^ ,  ....  xl)T  ■  (1) 


Without  loss  of  generality,  the  analysis  to  come  assumes  only  real  data  sets 
are  involved.  One  can  extend  the  development  to  complex  data  fields  by  simply 
substituting  Hermitian  conjugate  or  adjoint  operations  for  matrix/vector 
transpose  operations  where  they  occur  in  the  subsequent  text  (reference  4) . 

Let  S  denote  the  signature  library  matrix,  composed  of  the  M  possible 
signal  vectors  which  might  be  sent  through  the  channel.  Specifically,  one 
writes 


S  -  [sr  s2,  •••,  sMJ 


(2) 


where 


sj  '  lsiy  s2j . £lj 


(3) 


.th 


is  the  j  signal  vector.  In  this  form,  S  is  an  LxM  matrix.  For  this 
development  the  M  signals  are  assumed  to  be  a  linearly  independent  set 
(reference  4). 

For  the  L-sample  observation  period,  consider  the  possible  inputs  to  the 
receiver  to  be  either  noise  only  or  a  noise  plus  weighted  sum  of  the  signal 
vectors.  In  particular,  let  the  signal  portion  of  the  input  to  the  receiver 
be  written  as  the  column  vector 


-  Sa  - 


I  S..a, 
i-1  ^  1 


(4) 


with 


V  V 


.  .  ,  a. 


•  »T  _  ,  <  _  «•  w  r  if  f  t  W  *  .  1 ■'"V  f  *■"*  ■*,  "'.VV  «'  «•* »  ^ ^ •**» 

^-v-v-v^v. 
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denoting  a  M-element  column  vector  of  weight  coefficients.  If  the  noise 
incident  to  the  receiver  is  a  zero-mean  Gaussian  process  n  with  autocovariance 
K  -  E{nn  } ,  the  input  vector  x  has  the  following  form  for  hypotheses  Hq  and 
H^,  respectively 

HQ:  x  -  n  (5) 

under  the  noise -only  hypothesis  and 

H x  -  n  +  Sa  (6) 

under  the  signal-plus-noise  hypothesis.  In  the  latter  situation,  the  exact 
composition  of  the  weight  vector  a  is  assumed  to  be  known.  The  accepted  way 
to  process  this  data  is  through  a  log- likelihood  ratio  test.  In  the  following 
subsections  this  approach  is  reviewed,  and  with  it  a  maximum  likelihood  ratio 
test  is  developed  for  determining  the  presence  or  absence  of  a  library  of 
possible  signals  and  an  estimate  a  of  the  weight  vector  a.  In  addition,  some 
important  properties  and  aspects  of  this  test  are  derived.  The  first  sub¬ 
section  describes  classical  Neyman- Pearson  hypothesis  testing  (reference  1) . 

MAXIMUM  LOG -LIKELIHOOD  RATIO  TEST 

The  log- likelihood  ratio  test  is  based  on  the  logarithm  of  the  ratio  of 
the  probability  density  functions  associated  with  the  two  possible  simple 
hypotheses,  Ho>  the  noise-only  hypothesis  and  ,  the  signal-plus-noise 
hypothesis,  assuming  the  weight  vector  a  is  known.  When  a  is  known,  the 
optimum  test  is 


P,(x,a)  "1 

L<„)  -  -  log  -p;-  >  L0 

U  <  L 

L  Ho 


where 


Pi  (x-a)  “  M~n 
1  (2*)M/2 


P„(x)  -  777; 

°  (  2jt)M/2 


|  K |  | " 1/2  exp { - 1/2 (x  -  Sa)TK'1(x 


7777  I | K J  |'1/2  exp( -1/2xT  K_1x) 


P^x,  0)  . 


When  tl  e  weight  vector  a  is  unknown,  an  estimate  of  a  is  substituted  in 
equation  8  end  used  in  the  log- likelihood  test  given  in  equation  7.  The 
simplest  estimate  is  the  Maximum  Likelihood  Estimate  (MLE)  of  a  under 
hypothesis  1^.  Using  this  estimate,  the  log- likelihood  ratio  test  becomes 


L(x)  -  m^X  f (x,a)  -  f (x,a)  >  L 

<  L° 

H  0 
H0 


where 


f (x,a)  -  -l/2(x  -  Sa)TK'1(x  -  Sa)  +  1/2xTK‘1x 


-  (Sa)TK* ^x  -  l/2(Sa)TK'1(Sa) 


-IT  T-1T  -1 

(K  i)  -  [ E { nn 1 }  ]  -  K 


Equation  11  is  known  as  the  Maximum  Log -Likelihood  Ratio  Test. 

The  autocovariance  K  is  a  positive -definite  symmetric  matrix.  Hence,  it 
has  a  square -root  factorization  of  the  form 

K  -  K1/2K1/2  (14) 

where 

k‘1/2KK_1/2  -  IL  (15) 

1/2 

with  1^  denoting  the  LxL  identity  matrix.  The  matrix  K  is  used  to  "whiten" 
the  input  data  before  processing.  Mathematically,  we  write 

y  -  K~1/2x  (16) 

\  -  K  1/2n  (17) 


SR  -  K~1/2S  (18) 

as  the  "prewhitened"  input  vector,  noise  vector,  and  signal  library.  Since 
this  transformation  is  linear,  the  initial  multivariate  gaussian  nature  of  the 
data  is  retained  and  the  log- 1 ikel ihood  test  given  in  equation  11  becomes 


(19) 


f (x,a)  -  (Sa)^'1*  -  l/2(Sa)TK'1(Sa) 

H1 

-  'Xy  -  V2aT(SJsK)a  J  h>  . 

H0 

By  completing  the  square  in  equation  (19) ,  one  obtains 

f(x,a)  -  aTs£y  -  1/2 ([ (s£sk)1/2 ]Ta)T(s£sK)1/2a 

-  -l/2||(S^SK)1/2a  -  (s£sK)'1/2SKy||  +  l/2yTSK(s£sK)  '^y  (20) 


<  l/2yTSK(sJsK)'1S^y  (21) 

with  equality  if  and  only  if 

a  -  (S^SK)'1sJy  -  a(x)  .  (22) 

Equation  (22)  is  the  least- squares  estimate  of  the  weight  vector  a  one  obtains 

from  the  general  theory  of  regression  (reference  5).  The  existence  of  the 

T  -1 

inverse  matrix  (S  S  )  in  that  expression  is  guaranteed  by  the  assumption  of 
K  K. 

the  independence  of  the  K  signal  vectors.  It  is  clear  that  equality  holds  in 
equation  21  if  and  only  if  the  estimate  a(x)  in  equation  22  is  substituted 
into  f(x,a).  This  implies  that 

“I 

f (x,a, (x) )  >  L 

<  L° 

,,  o 


is  the  required  Maximum  Log-Likelihood  Ratio  Test.  Hereafter  in  this  paper, 
it  is  referred  to  as  the  Maximum  Likelihood  Ratio  Test  (MLRT) . 

As  noted  earlier,  the  above  test  is  a  Uniformly  Most  Powerful  Invariant 
Test  and,  as  a  consequence,  is  a  very  reasonable  way  of  detecting  the  presence 
of  a  linear  combination  of  M  signals  (reference  3).  In  addition,  it 
accomplishes  the  signal-presence/signal -absent  test  using  a  single  filter 
operation  before  threshold  comparison.  In  the  next  subsection,  the  rank  of 
this  processing  filter  is  obtained. 


RANK  OF  THE  FILTER  MATRIX 


In  the  last  subsection  the  maximum  log- likelihood  ratio  test  for 
determining  whether  one  or  more  signals  are  present  in  a  particular  data 
sequence  is  shown  to  be 

L(x)  -  l/2yTSK(S^SK)'1sJy 

-  1/2xTK‘1S(STK‘1S)STK‘1x 

where 

a(x)  -  (STK'1S)'1STK'1x  * 

As  noted  above,  the  estimate  a(x)  can  be  used  after  detection  for  the 
discrimination  of  a  signal  with  one  linear  combination  of  the  s  ' s  from  the 
set  of  signals  with  other  linear  combinations  of  the  linearly  independent 
waveforms . 

There  are  two  things  to  note  about  the  above  expressions:  1.  L(x)  is  a 
quadratic  form  in  the  input  vector  x  and  2.  a(x)  is  an  unbiased  estimate  of 
the  weight/amplitude  vector  a.  The  processing  filter  which  is  applied  to  the 
whitened  input  data  y  is  given  by 

H  “  SK(SKSK}  "  SKGK  (25) 

where 

GK  “  (SKSK)  SK  “  tgl’  82’  ***’  bL^  ^26) 

with 

8j  “  l6iy  8Mj]T. 

Rewriting  the  filter  H  in  more  specific  form,  it  is  apparent  that 

H”  *SKgl’  SKg2’  ***’  SKgL^  (27) 

implies  that  every  column  of  this  filter  matrix  is  a  linear  combination  of  the 

M  independent  column  vectors  of  S  .  Thus  the  rank  of  H  must  be  less  than  or 

K 

equal  to  M,  i.e.,  rank  (H)  <  M. 

Consider  the  product 


H1 

<  lG 

H0° 


(23) 


(24) 


This  expression  clearly  shows  that 


HSK(j)  “  SK(j) 


(28) 


for  all  j  -1,  2,  •••,  M.  Recall  that  S  represents  a  whitened  version  of 

K(j  / 


one  of  the  M  independent  column  vectors  of  S.  Equation  28  has  the  form  of  an 


eigenvalue  equation.  Equation  23  demonstrates  that  the  column  vectors  of  S 


are  distinct  and  independent  eigenvectors  of  the  matrix  operator  H  with  equal 
eigenvalues  of  magnitude  one  for  all  eigenvectors.  This  implies  that  the  rank 
of  H  must  be  greater  than  or  equal  to  M,  i.e.,  rank  (H)  >  M.  If  one  combines 
the  two  inequalities  for  the  rank  of  H,  the  rank  of  H  must  equal  M.  Thus,  the 
matrix  operator  H  has  M  eigenvalues  equal  to  one  and  (L-M)  eigenvalues  equal 
to  zero.  The  impact  of  this  is  that  even  though  each  of  the  .ignals  has  L 
components,  the  driving  factor  of  the  MLRT  in  terms  of  degrees  of  freedom  is 
the  number  M  of  signals  in  the  library  matrix.  In  the  next  section  the 
probabilities  of  false  alarm  and  detection  are  determined  for  the  MLRT. 


DETECTION  AND  FALSE  ALARM  PROBABILITIES  FOR  MLRT 


From  the  above  discussion,  the  maximum  likelihood  ratio  test  L(x)  can  be 
rewritten  as 


H, 


L(x)  -  L(y)  -  yTHy  J  ^0 


(29) 


H  , 


Let  U  be  an  orthogonal  unitary  matrix  which  diagonalizes  H.  Specifically,  U 
is  defined  to  be 


U  - 


K1 


K2 


KM 


5K1 1 


K2 


KM 


'Sl+l 


(30) 


which  gives 


T 

UHU  - 


L-M 


-  A. 


(31) 


8 


V  .  ■  *.  S 


-.  %  %  •-  ,\ 


>  V  V  V  •, 


'•  »•-  »'.  «'-  111  «*«■«'»  »*«  lit 


ta|'t  4**j| >.4 < 


(See  appendix  A  for  the  proof.)  By  defining  a  new  input  vector  by  the  relation 
y  —  Uz  (32) 

the  decision  strategy  for  simultaneous  multisignal  detection  becomes 


yTHy  ~  zTUHUTz  -  zTA^z  £  zf  u  (33) 

Rewriting  equation  32,  one  has 
T 

z  -  U  y  . 

The  probability  density  function  of  this  vector  is  similar  to  that  of  the 
original  measurement  vector  x,  except  this  new  distribution  has  a  new  mean  and 
covariance  values  (reference  3) .  Specifically  we  have 


"  2  *  2L0 


IlK-  |  I’172  exp|-l<z  •  d)TK'  'hz  -  d)j- 


where 


d  -  E{ z  } 


K'  -  E((z  -  d) (z  -  d)  )  . 


The  average  value  of  the  vector  z,  under  hypothesis  is  equal  to 

d  -  E{z |H1 )  -  E(UTnR  +  UTSRa} 

T 

-  U  SRa  . 

Its  covariance,  under  the  same  hypothesis,  is  given  by 

E(z  -  d) (z  -  d)T|H1 }  -  E{UTnRn^U} 

T  T 
-  U  E(nRnR !U 


Equation  38  also  holds  for  hypothesis  Hq  .  However,  the  mean  vector  d  for  Hj- 
is  the  null  vector. 


I 


Referring  to  equation  33,  it  is  clear  that  the  MRLT  decision  strategy 
depends  on  the  norm  of  the  vector  z.  Under  hypothesis  H^,  the  probability 
density  function  for  this  situation  is  the  noncentral  chi-squared  density 


/  \  ,,nM/ 2  - (r2+d2)/2 

Pl(r)  -  d(r/d)  e  "I 


(M-.2) 

2 


(rd) 


where  by  equation  33, 

M  J1/2 
Iz2 

U-1  JJ 


T  - 1  T  - 1  -1  T-l  1/2 

[(x  K  S) (S  K  iS)  (SAK  *)]  ' 


and 


o  9  T  T 

d  -  | d |  -  aS'uu  S  a 


T  -1 

a(S  K  S)a 


is  the  peak  signal-to-noise  ratio  (reference  6). 

The  probability  density  function  under  hypothesis  is 
chi -squared— and  is  derived  as  follows:  The  modified  Bessel 
first  kind  can  be  written  as 


Vc>  - 


y 

nirCi'  +  n  +  1) 

n=0 


Equation  39  then  becomes 


Pl(r) 


d(r/d)H/2e'<r2+d2>/2I 


HL21 

2 


(rd) 


(2)«/2e-<r2*d2)/2(r/2)«-l  » 


( l/2rd) 


2n 


n^Q  n!T(M/2  +  n) 


This  implies  that 


,  .  lim  .  .  -M/2,  . M - 1  -r  /2  1 

Po(r)  “  d-0  Pl(r)  2  (r/2)  6  T(M/2) 


is  the  probability  density  function  for  the  null  hypothesis, 
chi-aquared  density  function  with  M/2  degrees  of  freedom. 


(39) 

(40) 

(41) 

central 

function  of  the 

(42) 


(43) 

(44) 

Equation  44  is  a 
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Based  or  the  above,  one  can  write 


pd  -  d 


l 


.  ...M/2  -  (r2+d2)/2  .  ..  . 

(r/d)  e  Ii'M-2)  (rd)  dr 


(45) 


as  the  probability  of  detection  for  the  maximum  likelihood  ratio  test,  and 


fa 


r  11-  j. 

I  -M/2-1 


M-l  -r  /2 
e  ' 


dr 


(46) 


r(M/2) 


as  its  probability  of  a  false  alarm.  In  these  two  equations  b^  is  the  MLRT 
threshold  level  in  normalized  units.  If  one  refers  to  the  usual  analysis  of  a 
multiple  signal  detection  (e.g.,  reference  1),  equations  45  and  46  indicate 
that  MLRT  has  one  half  the  number  of  degrees  of  freedom  that  would  normally  be 
expected  for  this  type  of  detection  strategy. 


COMPUTER  SIMULATIONS 


With  the  above  detection  strategy  defined,  a  validation  of  the 
maximum  likelihood  ratio  test  was  performed.  In  addition,  the  quality  of  the 
weight  vector  estimation  under  positive  processor  response  was  concurrently 
assessed.  Three  computer  simulations  were  performed  which  assumed  the  number 
of  signals  in  the  library  to  be  of  lengths  2,  4,  and  6. 

In  the  following  subsection,  the  performance  of  the  MLRT  is  summarized 
for  the  six-signal  library  simulation.  For  simplicity,  the  input  noise  is 
assumed  to  be  Additive  White  Gaussian  Noise  (AWGN) . 

The  simulations  were  performed  on  a  AT-clone  Personal  Computer  with  an 
80287  Co-processor.  The  computer  programs  themselves  were  written  in 
Microsoft  FORTRAN,  Version  3.31,  and  required  externally  generated  random 
numbers  to  create  the  simulated  noise  sequences. 

The  uniform  random  deviates  are  generated  from  the  RANI  and  RAN3 
subroutines  developed  by  Knuth  and  others  (reference  7).  These  routines 
create  uniformly  distributed  numbers  between  0.0  and  1.0  with  negligible 
sequential  correlations.  These  numbers  are  translated  into  normal  deviates 
(zero  mean  and  unity  variance)  using  a  technique  suggested  by  Dillard 
(reference  8). 


The  linearly  independent  signals  chosen  for  the  simulations  were  binary 
(+1,-1)  pulse  sequences  with  various  power-of-two  frequencies.  The  computa¬ 
tion  of  the  theoretical  false  alarm  and  detection  probabilities  were  performed 
using  a  recursive  relation  for  the  generalized  Q-function  described  by 
Dillard  (reference  9) . 

The  six-signal  library  simulation  was  performed  as  follows.  Six  linearly 
independent  signal  vectors  were  generated.  The  selected  signal  cycles  were  2, 
4,  8,  16,  32,  and  64  Hz.  The  length  of  each  sample  vector  was  128.  This  is 
chosen  to  accommodate  two  cycles  of  the  lowest  frequency  waveform.  Under  the 
AWGN  assumption,  the  processing  filter  H  described  in  equation  25  was  created 
and  stored,  as  well  as  the  estimating  filter 

T  -1  -IT  -1 

H  -  (S  K  S)  S  K  .  (47) 

Ten  thousand  null-hypothesis  sequences  and  ten  thousand  signal-present  data 
sequences  were  independently  generated  and  applied  to  both  filters.  The 
filtered  results  were  stored  and  later  statistically  analyzed. 

Figure  2  shows  the  theoretical  and  simulation-derived  false  alarm 
probabilities  for  the  six-signal  library  MLRT  case.  The  error  bars  were 
computed  using  the  analytical  expression  developed  by  Clopper  and  Pearson 
(reference  10).  Figure  3  compares  theoretical  and  computer -generated  results 
for  the  probability  of  detection  as  a  function  of  threshold  for  input 
s ignal - to -noise  ratios  equal  to  128,  288,  and  512.  Both  figures  illustrate 
good  agreement  between  simulation  and  theory.  This  good  agreement  is 
similarly  found  for  the  two-  and  four-signal  library  simulations  not 
discussed . 

The  LMS  estimate  of  the  weight  vector  a  gave  good  results  in  predicting 
the  presence  and  amplitude  of  the  appropriate  signal  when  hypothesis  is 
true.  The  covariance  of  the  prediction  can  be  shown  (reference  5)  to  be  given 
by 

o\  -  E(  aaT  |  H  ^ }  -  [  E{  a  |  HL  )  Ela1^}]  =  (sV^)"1  .  (48) 

All  three  simulations  exhibited  this  variation  in  the  statistics  of  the  weight 
vector  estimate.  In  the  six-signal  library  case,  the  normalized  standard 
deviation  of  the  estimate  was  -9%  as  expected.  This  expression  shows  that  the 
accuracy  oi  the  estimation  is  inversely  proportional  to  the  inherent  signal - 
to-noise  ratio  of  each  waveform  in  the  signal  library.  This  is  not  an 


Figure  2  A  comparison  of  the  false  alarm 
probability  for  a  six-signal  library  MLRT  with 
computer  simulation-derived  data 


PROBABILITY  OF  FALSE  DISMISSAL.  1  -  P„  (percent) 

99  99  99  9  99  90  50  10  1  0  1  0  01 


PRORABIl  IIY  Ol  DETECTION  P.  .pi-r.-ent, 


Figure  3  A  comparison  of  the  detection  piobahditv  for  a  six 
signal  library  MLRT  with  computer  simulation  derived  data  at 
signal  to  noise  ratios  of  128  288  and  812 


unexpected  result.  Parameter  estimation  is  always  better  with  strong  signals 
(reference  5). 

A  COMPARISON  OF  MLRT  AND  THRESHOLDED/SIGNAL- CORRELATION  RECEIVERS 


To  demonstrate  the  power  of  the  MLRT  procedure,  a  comparison  is  made 
between  this  new  detection  strategy  and  a  strategy  based  on  the  approach  shown 
in  figure  1.  One  of  the  most  common  techniques  for  M-ary  hypothesis  testing 
is  to  use  a  filter  bank  of  M  signal  correlators  with  a  threshold  signal- 
presence  detection  criteria  (reference  1) .  The  outputs  of  the  M  correlators 
are  compared  to  a  predetermined  value  and  those  exceeding  this  value  are  said 
to  indicate  signal  presence  during  that  observation  time.  The  null  hypothesis 
occurs  when  none  of  the  correlator  outputs  exceed  the  predetermined  threshold. 
The  particular  threshold  value  selected  is  based  on  the  desired  probability  of 
error . 

In  this  section  a  comparison  is  made  between  a  MLRT  receiver  and  the 
above-cited  filter  bank  receiver  for  the  case  of  6,  200,  and  400  linearly 
independent  signals  at  two  fixed  false  alarm  rates.  These  examples  illustrate 
the  relative  performance  of  these  two  M-ary  detection  techniques,  but  more 
importantly  they  scope  the  kind  of  penalties  encountered  from  the  use  of  the 
less  computationally  intensive  MLRT  detection  strategy.  In  other  words,  these 
comparisons  demonstrate  how  close  to  optimum  the  MLRT  really  is. 

Assume  that  a  receiver  filter  bank  has  beer,  created  to  determine  which  of 
M  possible  signals  is  sent.  The  M  waveforms  of  interest  are  all  of  equal 
energy.  For  this  comparison,  AWGN  with  zero  mean  and  unit  variance  again  is 
assumed.  In  order  to  compare  the  detection  performance  of  the  filter  bank 
receiver  with  a  MLRT  receiver,  analytical  expressions  for  the  probabilities  of 
false  alarm  and  detection  of  the  correlation  receiver  must  be  determined. 

The  probability  of  the  correct  "reception"  of  the  null  hypothesis  is 

p [ correc 1 1 HQ ]  -  Pr<all  S^K^x  <  bQ;  j  -  1,  2,  3,  •••,  M|Hq1  (49) 

M 

“  n  Prls  K  x  <  bQ)  (50) 

j-1 


aO 


M 

Pn(r)dr 


(51) 
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(52) 
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.M  .‘i  i 


.44  .<4  .  4  , 


The  integral 


(r)dr 


represents  the  probability  of  choosing  the  signal  presence  hypothesis  after 
thresholding  when  the  null  hypothesis  is  true.  This  is  the  false  alarm 
probability  or  the  Error  of  the  First  Kind.  For  AWGN,  equation  52  is  defined 


erfc(bQ)  -  (2tO'1/2  J  exp(-t2/2)  dt 


As  before,  b^  is  the  receiver  threshold  setting. 

The  probability  of  false  alarm  is  the  difference  between  equation  51  and 
unity.  Specifically,  the  false  alarm  probability  for  a  M-ary  filter  bank  with 
threshold  detection  is  given  by 


pfa  -  1  -  p ( correct | ]  -  1  -  (1  -  erfc(bQ))M  . 


Rewriting  equation  52,  one  has 

erfc(bQ)  -  1  -  (1  -  Pfa)VM  •  (55) 

This  last  expression  can  be  used  to  determine  the  threshold  setting  for  a 
fixed  false  alarm  probability  using  an  inverse  error- function  integral 
relation  (reference  11) . 

Since  the  assumed  waveforms  have  equal  energy,  their  integrated  power 
levels  are  also  equal.  The  probability  of  detection  is,  therefore,  the  same 
for  each  of  the  M  signal  correlators  and  is  given  by 

_  b 

Pd  -  1  -  (1  -  erfc (bQ  -  /SNR))  (56) 

with  SNR  representing  the  expected  signal - to-noise  ratio  for  each  and  b^  being 
the  number  of  waveforms  per  complex  signal  (reference  12).  Equation  56 
assumes  that  the  probability  of  false  alarm  at  every  filter  contributes 
nothing  to  the  detection  of  any  signal.  For  this  analysis,  the  number  of 
waveforms  per  signal  is  1  and  equation  56  reduces  to 

Pd  =*  erfc(bQ  -  d)  ,  (57) 


m 
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Figure  4  compares  the  probability  of  detection  for  MLRT  and  filter  bank 
receivers,  given  six  linearly  independent  signals,  as  a  function  of  signal - 
to-noise  ratio  for  false  alarm  probabilities  of  IE-04  and  IE-06.  The  MLRT 
results  are  computed  using  equations  45  and  46,  and  the  filter  bank  numbers 
were  computed  using  equations  55  and  57.  It  is  apparent  that  the  filter  bank 
performs  better  than  the  MLRT  for  all  signal- to-noise  ratios  shown.  However, 
MLRT  suffers  only  a  1  dB  penalty  over  this  same  range  and  is  less  computa¬ 
tionally  intensive  for  situations  when  the  null  hypothesis  is  the  most 
frequently  occurring  event.  This  supports  the  previous  contention  that  MLRT 
is  a  near-optimum  M-ary  detection  strategy  for  AWGN,  or  at  least  for  small 
signal  library  scenarios.  The  signal-to-noise  ratio  penalty  for  large  signal 
library  detection  is  investigated  next. 
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PROBABILITY  OF  DETECTION  P„  (percent) 

Figure  4  The  probability  of  detection  false  dismissal  as  a  function 
of  signal  lo  noise  ratio  for  MLRT  and  filter  bank  receivers  at  false 
alarm  probabilities  of  1  E  04  and  1  E  06,  and  with  M  equal  to  6 

For  large  numbers  of  signals,  the  probabilities  of  false  alarm  and 
detection  for  the  MI.RT  reduce  to 

Pfa  =  erfcdbo  '  (58) 

and 

pd  *  erfc  (b^  -  M  -  d?)//?(M  i  (‘,9) 
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respectively,  for  values  of  M  greater  than  200  (see  appendix  B) .  The  false 
alarm  and  detection  probabilities  for  the  filter  bank/threshold  receiver  are 


Pfa  ~  M  erfc  (bQ)  (60) 

and 

Pd  ~  erfc  (bQ  -  d)  .  (61) 

Equation  60  assumes  that  erfc(bQ)  «  1.  Figure  5  compares  the  probabilities 
of  detection  for  the  MLRT  and  the  filter  bank/threshold  receivers  for  M  -  200 
and  false  alarm  probabilities  of  IE-04  and  IE-06.  As  expected,  the  filter 
bank/threshold  receiver  performs  better  than  the  MLRT  receiver.  In  fact,  it 
is  around  4.5  to  5  dB  better  for  reasonable  detection  probabilities.  This  is 
really  not  too  bad  considering  the  reduced  computational  load  requirements  one 
has  with  the  latter.  Figure  6  depicts  the  same  comparison  as  figure  5,  except 
for  M  -  400.  This  figure  shows  the  MLRT  receiver  has  a  1  to  1.5  dB  increase 
in  SNR  penalty  for  the  factor  of  two  increase  in  the  number  of  signals. 

Again,  this  is  not  a  significant  penalty  for  the  reduced  data  processing  load. 
However,  the  choice  depends  on  the  application. 

When  the  signals  of  interest  are  linear  combinations  of  linearly 
independent  waveforms,  the  MLRT  detection  strategy  is  the  definitely  preferred 
approach.  This  is  because  the  MLRT  filter  causes  the  linear  combination  of 
waveforms  to  incoherently  add  their  respective  energies  before  thresholding. 

As  an  example,  figure  7  shows  the  probability  of  detection  for  false  alarm 
probabilities  of  IE-04  and  IE-06  where  each  complex  signal  is  assumed  to  be 
composed  of  two  linear  independent  waveforms.  It  is  clear  in  this  figure  that 
MLRT  performs  better  over  most  r'  the  si gnal - to- noise  ratio  range  shown  at 
both  false  alarm  probabilities.  MLRT  has  the  effect  of  linearly  increasing 
the  total  signal - to-noise  ratio  within  the  test  by  the  total  number  of  signals 
in  the  linear  combination.  In  this  case,  the  linear  increase  in  signal -to- 
noise  ratio  is  a  factor  of  2  or  3  dB .  On  the  other  hand,  the  correlator  bank 
still  looks  for  transmitted  signals  on  an  individual  linearly  independent 
waveform  detection  basis  and  is  not  able  to  take  advantage  oi  the  total  energy 
of  the  complex  signal.  The  probability  of  detection  for  the  filter  bank  is 

Pd  »  1  -  (1  -  erfc(bQ  -  d) )?  (67) 

with  d  again  being  the  signal -to-noise  ratio  of  the  individual  waveforms. 
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Figure  7  The  probability  of  detection/false  dismissal  as  a  function 
of  signal-to-noise  ratio  for  two-signal-combination  MLRT  and  filter 
bank  receivers  at  false  alarm  probabilities  of  1  E-04  and  1  E-06, 
and  with  M  equal  to  6 

SUMMARY 

This  paper  has  presented  a  new  strategy  for  detecting  and  estimating 
multiple  linearly  independent  signals  immersed  in  additive  random  noise.  This 
technique  is  most  useful  for  communication  and  surveillance  applications. 

This  new  approach  determines  the  presence  of  one  or  more  signals  through  a 
single  filter  operating  on  the  received  input  vector,  and  performs  a  signal- 
amplitude  estimation  when  a  positive  response  occurs.  It  is  a  Uniformly  Most 
Powerful  Invariant  Test  and  reduces  the  compu'  .tionally  intensive  work  to  only 
those  situations  where  important  data  may  exisc.  The  estimation  technique 
determines  the  signal  amplitude  of  all  the  possible  input  signals  in  an  LMS 
sense  with  variance  inversely  proportional  to  the  inherent  signal-to-noise 
ratio  of  each  linearly  independent  waveform. 

Computer  simulations  verify  the  theory  and  demonstrate  near-optimum 
performance  of  MLRT  for  small  signal  libraries.  The  MRLT  is  close  to  optimum 
for  larger  signal  sets  and  is  clearly  optimum  for  complex  multiwaveform 


APPENDIX  A:  THE  UNITARY  TRANSFORMATION  MATRIX  U  WHICH  DIAGONALIZES  H 


It  is  known  that  any  arbitrary  L  x  N  matrix  F  of  rank  M  can  be  decomposed 
into  the  sum  of  a  weighted  set  of  unit  rank  L  x  N  matrices  by  a  singular  value 
decomposition  (SVD)  (references  13,  14).  Application  of  this  concept  to  the 
MLRT  processing  filter  H  will  be  used  to  determine  the  unitary  transformation 
matrix  U. 

According  to  the  SVD  matrix  decomposition,  there  exists  an  L  x  L  unitary 
matrix  U  for  which 


UHUT  -  A1/2 


where 
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The  matrix  A  is  called  the  singular  value  of  the  matrix  H. 

T  T 

Since  U  is  an  unitary  matrix,  U  U  -  UU  -  1^.  Consequently, 

H  -  UTA1/2U  • 

The  rows  of  the  unitary  matrix  U  are  composed  of  the  eigenvectors  of  the 
T 

product  matrix  HH  .  The  defining  relation  is 
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where  A(j)  are  the  nonzero  eigenvalues  of  the  matrix  HH  (reference  13). 
Since  H  is  a  symmetric  matrix, 

T  T  -1  T  T  -1  T 

“  -VW  WW  SK 

T  -IT 

-  VW  SK 

-  H  , 


(A-7) 


Substituting  equation  A-7  into  equation  A-6,  we  obtain 
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L  -  M 


The  MLRT  processing  filter  H  has  been  shown  in  the  main  text  to  have  M  unity 
eigenvalues  with  associated  eigenvectors  equal  to  the  columns  of  S^.  This 
implies  that  equation  A- 2  becomes 
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taking  into  account  the  unitary  nature  of  U.  The  vectors  (UM+^ . u^) 

remain  arbitrary,  subject  only  to  the  unitary  requirement  of  U  (reference  15) 
Substituting  the  eigenvalues  of  H  into  equation  A-8  yields 


(A-  1C 


which  completes  the  derivation  of  U. 


APPENDIX  B:  APPROXIMATE  EXPRESSIONS  FOR  THE  PROBABILITIES 
OF  DETECTION  AND  FALSE  ALARM 


When  the  number  of  waveforms  M  in  the  signal  library  of  MRLT  is  large, 

2  M  2 

the  probability  density  function  (pdf)  of  the  statistic  r  -  £  z.  is  nearly 

j-1  J 

Gaussian  by  virtue  of  the  Central  Limit  Theorem.  Following  Helstrom 

2 

(reference  1),  an  asymptotic  expression  for  the  pdf  p^(r  )  is  derived  in  this 
appendix  which  exhibits  this  limiting  Gaussian  character  and  is  used  to 
establish  approximate  expressions  for  the  probabilities  of  detection  and  false 
alarm  associated  with  this  new  log- likelihood  ratio  test  for  large  M. 

Recall  that  the  logarithm  for  the  characteristic  function  h(z)  of  a 
random  variable  x  can  be  expressed  in  a  power  series  of  the  form 


In  h(z)  -  izx  + 
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where 

x  -  E{x)  , 

2  -  2 
a  -  E( (x  -  x)  )  , 

and  is  the  "k-th  cumulant"  of  the  random  variable  x.  This  implies  that 

-  2  2 

h(z)  -  exp  (izx  +  a  (iz)  /2 !  )  • 

after  collecting  terms  with  like-powers  of  (iz).  The  coefficients 
contained  in  equation  B-2  have  the  form 
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and  so  on.  The  pdf  of  x  is  the  inverse  Fourier  transform  of  the 
cnaracteristic  function  h(z)  and  is  equal  to  the  following: 
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The  functions  h^(u)  in  equation  B-3  denote  Hermite  Polynomials  which  are 
defined  by  equation  B-5. 

Evaluating  equation  B-3  when 
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The  probability  of  detection  is  given  by  the  termwise  integration  of  this 
density  function.  The  probability  of  a  false  alarm  is  also  obtainable  from 
equation  B-8  by  setting  S  -  0  before  the  termwise  integration. 

When  M  is  large,  only  the  first  two  terms  of  equation  B-8  need  be 
retained.  The  probabilities  of  false  alarm  and  detection  in  this  case  after 
termwise  integration  are 


Pfa  -  erfc(L') 


(B- 10) 
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